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Abstract 


This paper presents a review of distance education literature published in the 
Turkish Online Journal of Distance Education (TOJDE) to describe the status 
thereof and to identify gaps and priority areas in distance education research 
based on a validated classification of research areas. The articles (N = 784) 
published between 2000 and 2015 were reviewed for this study. Findings 
indicated that issues related to educational technology are a popular research 
area in articles published in TOJDE. Nearly all the articles are 
theoretical/descriptive, quantitative, or qualitative in nature. According to 
publication and authorship patterns, TOJDE is an international journal with a 
special ability to reflect developments in its near region in the field of distance 
education. 


Introduction 


In any discipline, to understand the past and the present, as well as to achieve success in 
the future it is necessary to benefit from what has already been experienced. Within this 
perspective, it is of the utmost importance to define research areas of distance education 
and fill in these areas with scholarly experience and research-based evidence. In this 
regard, this paper addresses questions in the following areas with a special emphasis on 
Turkish distance education research: 


e Distribution of research areas; 
e Analysis of research methods; 
e Geographical distribution; 

e Gender and research methods. 
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Literature Review 


Two other articles have analysed the research trends in TOJDE, in a way that is similar to 
the aim of this article. The overall objective of those studies was to identify the research 
trends in TOJDE over a specific time period. Latchem (2009) conducted a content analysis 
of the Notes for Editors and articles published in the journals issued between 2000 and 
2008. The analysis involved determining the articles’ countries of origin, sectors 
represented, and focus and frequency of the topics covered. It was reported that the 
majority of articles were from Asian countries, with Turkey providing the greatest number 
of contributions. There were also many papers from the Middle East, Africa, South 
America, USA, Eastern and Western Europe, and Australia. According to Latchem, some 
of the papers, presenting non-Western perspectives, are particularly illuminating. The 
earlier articles tended to be descriptive or theoretical, but the latter papers were 
quantitative-experimental and qualitative-descriptive studies into distance education and 
e-learning needs, policies, procedures, practices and outcomes. Ozarslan, Balaban-Sali, 
and Demiray (2012) analysed the articles in TOJDE published between 2000 and 2010 by 
focusing on research topics, methods, instruments, statistical methods, author numbers 
and their institutional affiliation. They reported that single-author articles constitute the 
largest proportion of TOJDE. It was also indicated that Turkey, USA, India, Nigeria, 
Malaysia, Pakistan, Australia, Canada, UK, Bangladesh, Greece, and Iran, respectively, are 
the chief contributors to TOJDE. In addition, the researchers identified 17 research topics 
in TOJDE. Accordingly, (a) Learner and instructor experiences in online learning 
environment; (b) information about the system and program; (c) economic, social and 
cultural dimension of distance education, and (d) pedagogical, political, philosophical, 
legal, ethical reflections in distance education are top four research topics in TOJDE. In 
terms of method, it was found that the quantitative studies far outweighed the qualitative 
and mixed studies. Bozkurt, Zawacki-Richter, and Aydin (2019) conducted social network 
analysis to identify keyword patterns and found that TOJDE largely focused on technology- 
related issues. 


In addition to attempts to identify research trends in TOJDE, the following studies 
included TOJDE into their research within different perspectives. For instance, Zawacki- 
Richter, Anderson, and Tuncay (2010) investigated impact of 12 distance education 
journals (6 open and 6 published in closed format by commercial publishers). The impact 
and perceived value of the journals was identified through citation analysis of the 
published issues from 2003 to 2008, and with a survey with the editors of the journals. They 
found that articles in open access journals, such as TOJDE, are cited more quickly than in 
closed format journals. They also reported that both open and closed journals are not 
significantly different in terms of prestige. Zawacki-Richter and Anderson (2011) analysed 
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the relationships and influences in peer reviewed distance education journals using social 
network analysis and multidimensional scaling. With this aim, they sampled 1416 
scholarly articles published from 2003 to 2008. They used journals as nodes and citations 
patterns as relationships. In their research, they found that TOJDE is one of the journals 
in the core of the citation network. This finding was confirmed in a study by Perkins and 
Lowenthal (2015) who examined open access journals in educational technology through 
a survey among more than 300 educational technology academics. The reported that 
TOJDE is one of the most influential open access journals. 


Methodology 


This study is a literature review that intends to reach a synthesis by examining articles 
published in TOJDE. For this purpose, review study benefits from traditional content 
analysis (Wilson, 2011). This research adopts a quantitative approach, which mostly relies 
on counting, to identify research themes in articles published in TOJDE. For this study, all 
the articles published in TOJDE between 2000 and 2015 were reviewed (N = 784). Book 
reviews and editorial notes were excluded from the sample. 


Results and Discussion 
Distribution of research areas 


The classification of research areas for this review is based on the framework developed by 
Zawacki-Richter (2009). When examined, it can be seen that educational technology 
(23.72%) is the most studied research area. Learner characteristics (16.84%), theories and 
models (9.44%), professional development and faculty support (7.02%), instructional 
design (6.51%), and research methods in distance education and knowledge transfer 
(6.51%) are, respectively, the most studied research areas in TOJDE (Table 1). 


Table 3: Distribution of Research areas 


2000-2015 2000-2015 
AREAS 2000-2003 | 2004-2007 | 2008-2011) 2012-2015; TREND COUNT | PERCENTAGE 


1-Access, equity and ethics 


2-Globalisation of education and cross-cultural asp} 


3-Distance teaching systems and institutions 


4-Theories and models 


5-Research methods in distance education and kno’ 
6-Management and organisation 

7-Costs and benefits 

8-Educational technology 


9-4Innovation and change 


10-Professional development and faculty support 


11-Learner support services 


12-Quality assurance 


13-Instructional design 


14-Interaction and communication in learning comm 


15-Learner characteristics 
PERCENTAGE 
TOTAL (BY PERIODS) 
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Zawacki-Richter, Backer, and Vogt (2009) reported that articles published in prominent 
DE journals between 2000-2008 demonstrated that interaction and communication in 
learning communities (17.6%), instructional design (17.4%), learner characteristics 
(16.3%), distance teaching systems and institutions (8.9%) and educational technology 
(6.9%) were mostly employed in research areas. In a follow-up study, Bozkurt et al. (2015) 
found that articles in DE journals published between 2009-2013 indicated that educational 
technology (15%), interaction and communication in learning communities (13%), learner 
characteristics (12%), instructional design (11%), and distance teaching systems and 
institutions (8%). The increasing trend of “educational technology” as reported by 
Zawacki-Richter et al. (2009) and Bozkurt et al. (2015) is confirmed by the findings of the 
current research (see Table 1). Bozkurt et al. (2015) highlights that DE is strongly related 
to technological developments and reacts swiftly to these developments. 


Analysis of research methods 


This research adopted the schema of research methods proposed by Bozkurt, Akgiin- 
Ozbek, and Zawacki-Richter (2017). Research methods and models/designs are coded 
according to quantitative, qualitative, mixed/triangulation, conceptual/descriptive/other, 
practice based, and data mining and analytics paradigms. Accordingly, researchers mainly 
preferred theoretical/ descriptive (40.43%), quantitative (39.92%), qualitative (15.43%), 
mixed/ triangulation (3.7%) and practice-based (0.51%) methodologies. There was no 
research from the emerging research paradigm of data mining and analytics. Of all the 
research models and designs, literature reviews and reports in theoretical/descriptive; 
surveys, correlational and experimental research in quantitative; descriptive studies and 
case studies in qualitative; explanatory design in mixed methodology, and finally action 
research in practice-based research methodologies are mostly used (Table 2). 
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Table 2: Trends in research method and model/design 


Method Model/Design iF Within Method %| Total % 
Conceptual/Descriptive/Other Literature Reviews 
40,43% (n=317) Reports (eal 67 21,14 8,55 
Technical Paper 4 1,26 0,51 
Comparative 0 0 0 
Field Notes 0 0 0 
Opinion Paper 0 0 0 
Position Paper 0 0 0 
Reflection Paper 0 0 0 
Systematic Review 0 0 0 
Quantitative Survey 
39,92% (n=313) Correlational 74 3,64 9,44 
Experimental Si 11,82 4,72 
Casual comparative i. 3 0,96 0,38 
Meta-Analysis 1 0,32 0,13 
Qualitative Descriptive H 66 8,42 
15,43% (n=121) Case Study | 29 OF 3,7 
Content Analysis 18 14,88 PR) 
Phenemology 4 eeh| 0,51 
Delphi 2 1,65 0,26 
Ethnography 2 1,65 0,26 
Grounded Theory | 2 1,65 0,26 
Narrative 2 1,65 0,26 
Discourse Analysis | 1 0,83 0,13 
Naturalistic Inquiry 1 0,83 0,13 
Historical 0 0 0 
Heuristic 0 0 0 
Meta-Synthesis 0 0 0 
Mixed Explanatory 15 1,91 
3,70% (n=29) Exploratory 9 ‘ails 
Convergent | 6 0,69 0,77 
Embedded 0 0 0 
Transformative 0 0 0 
Multiphase 0 0 0 
Practice-Based Action Research 3} 0,38 
0,51% (n=4) Design-Based Research i 25 0,13 
Data mining and analytics Learning Analytics 0 0 0 
0% (n=0) Social Network Analysis 0 0 0 
Text Mining 0 0 0 
Log Analysis 0 0 0 
Internet and Traffic Ranks 0 0 0 
Sentiment Analysis 0 0 0 


Similarly, Berge and Mrozowski (2001), who examined research trends in distance 
education between 1990 and 1999, reported that of all the articles examined, 74.83% was 
descriptive studies. Zawacki-Richter et al. (2017), who examined articles published in 
IRRODL between 2000 and 2015, also reported that 44.5% of all articles were 
theoretical/descriptive studies. The majority of theoretical/descriptive studies something 
expected in distance education journals. The rationale behind this scene might be the 
nature of the field. Accordingly, distance education is an interdisciplinary and pragmatist 
field, which frequently benefits from innovative technologies and other developments in 
educational sphere. Therefore, theoretical/descriptive papers can be considered as the first 
phase to understand innovative technologies and developments in education field. As 
indicated in many reports, distance education and educational technology are exposed to 
constant changes and these types of papers can be considered a natural, expected phase for 
the adaptation of the field. 
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Geographic distribution 


For the analysis of geographical, countrywise distribution of the articles, countries of the 
first author were included in the analysis. Of all the 784 articles came from 67 different 
countries (Table 3), almost one third of the articles came from Turkey. India, the USA, 
Malaysia and Pakistan comprised the countries from where the majority of the articles 
originated (Table 3). 


Table 3: Distribution of articles by country 


IR [Country |F_|% ~—|R_[Country 
“anda reel —isltse a 
2|India B72 18|Russia 
asia ———B-solf | —toson Ta 
4| Malaysia ic 38 Bahrain 
=e 
Nigeria 4 59 Finland 
| 7iran 25) 3,19] to] tsraet | 
Greece 24|) 3,06 Jordan 
[apo el Sef 
ce. ee me 
UK | 2 42| 20|Barbados 0,2 Morocco 


ee | ee 
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to | do 
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w 


eh | et | ok | me | me 
[oe oe oe ee 


Netherlands 
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Serbia 
Slovenia 
Spain 
Swaziland 
21| Switzerland 
21 Evie 
= South Africa 0, 64) 20)|Tanzania Uganda 
ae oe ee ee el 
isles ——] a esteem} to) — 
Philippines 0,51 1|Belgium 0,13 


*USA: United States of America; UK: United Kingdom; UAE: United Arab Emirates; BH: Bosnia and Herzegovina; Cl:Cayman Islands. 
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*only the country of the first author was taken into consideration 


First, these findings indicate that TOJDE is an international distance education journal. 
Secondly, TOJDE is a regional voice of the Asian continent. As was seen in Table 3, a great 
majority of the articles were published from countries such as India, Malaysia, Pakistan 
and Iran where distance education programs are part of mainstream education. Finally, to 
identify the geographical distribution patterns is important as it can be considered an 
indicator of the research productivity of individual countries or regions. Such analysis 
could be very helpful for identifying gaps and priorities in research based on the current 
status of distance education in specific regions. 


Gender and research methods 


According to gender analysis and the methods used, it could be seen that 481 (61.4%) of 
the first authors were male, 302 (38.5%) were female and 1 (0.1%) was institutional. In 
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terms of the frequency of the publications, it can be seen that the male researchers showed 
much more interest than the female researchers (Table 4). The same patterns were also 
observed by Zawacki-Richter and von Priimmer (2010) who examined articles published 
in five distance education journals between 2000 and 2008 (Male: 55.4%, Female: 44.6%), 
and Zawacki-Richter et al. (2017) who examined articles published in IRRODL between 
2000 and 2015 (Male: 55.9%, Female: 44.1%). 


In the related literature, it was reported that there was a relationship between gender and 
the preferred research paradigm (Carlson, 1972; Grant, Ward, & Rong, 1987), however 
some others claimed that there is no such relationship (Goldenberg & Grigel, 1991). Mishra 
(1997), Zawacki-Richter et al. (2009), and Zawacki-Richter and von Priimmer (2010) 
further highlighted the relationship between gender and research paradigms in distance 
education. In order to explore if there is an association between gender type and research 
paradigm in the sampled articles published in TOJDE, we conducted a chi-square analysis. 
In order to do this, one paper, which was written by an institute, was omitted from the 
sample. Data mining and analytics was not counted in by the statistical software because 
it had a 0 value. Accordingly, in a 5 x 2 table, there was no significant association between 
gender and the preferred research paradigm x2 (4) = 4.9, p > .05. 


Table 4: Cross tabulation of gender (first author) and research paradigms 


Female 
Count 132 
% within method ~ 2 
Count 
% within method zt 0 
Count 
% within method a 8 
Count 109 
% within method = 8 
Count 

% within method 
Count 

% within method 
Count 

% of total a 7 = oe 


Quantitative 


Qualitative 


Mixed/Triangulation 


Conceptual/Descriptive/Other 


Practice based 


Data mining and analytics 


Total 


Conclusions 


The current findings indicated that of all the 15 research areas, educational technology 
(23.72%) is the most studied research area. Learner characteristics (16.84%), and theories 
and models (9.44%) are the other most studied research areas. It is also salient that these 
research areas comprise 50% of all the research areas. In terms of the research methods 
and models/designs, theoretical/descriptive (40.43%), quantitative (39.92%), and 
qualitative (15.43%) research paradigms, all of which constitute 95.78% of the research 
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methods mostly used in articles published in TOJDE. Mixed/triangulation, practice-based, 
and data mining and analytics were the least preferred research paradigms. Among the 
many research models/designs, literature reviews (31.38%), and survey studies (24.36%) 
constituted 56.16% of all research models/designs. Furthermore, it was also seen that the 
784 articles originated from 67 countries, which means that TOJDE published articles from 
nearly one third of the world’s nations. It was also seen that TOJDE, as an international 
open access journal, is the representative of its own region, mostly developing countries, 
and is also representative of many other countries, which makes it an important 
publication venue. The analysis on the relationship between gender and research methods 
was found not to be statistically significant, yet it was also seen that male researchers 
published more articles than female researchers did. 
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